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Mail Stop 8 REPORT ON THE 

Director of the U^. Patent and Trademark Office FILING OR DETERMINATION OF AN 

P.O. Box 14S0 ACTION REGARDING A PATENT OR 
Alexandria, VA 22313-14S0 TRADEMARK 



In Compliance with 35 U.S.C. § 290 and/or 15 U.S.C. § 1 116 you are hereby advised that a court action has been 

filed in the i],s. District Court Northern District of California ^^^^^^^^ ^ p^^^^^^ Q j^^^^, 



DOCKET NO. 


DATEFII|g^2008 


U.S. DISTRICT COlfRT ^. * ^ * . * 

Northern District of California 


PLAINIIFF 

PHOENIX SOLUTIQfcJS. jNC, a Cailfornia corporation 

E-filing Q-\ 


DEFENDANT 

WELLS FARGO & COMPANY, a Delaware corporation 

' 08 0863 


PATENT OR 
TRADEMARK NO. 


DATE OF PATENT 
OR TRADEMARK 


HOLDER OF PATENT OR TRADEMARK 


1 6633846 


1/14/20)3 


EMC 

PHOENIX SOLUTIONS, INC. i^xv AV.^ 


2 6665640 


12/16/2003 


PHOENIX SOLUTIONS. INC. 


3 7050977 


5/23/2006 


PHOENIX SOLUTIONS, INC. 


4 7277854 


10/2/2007 


PHOENIX SOLUTIONS, INC. 
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In the above— entitled case, the following patent(s)/ WademarkCs) have been included: 



DATE INCLUDED 


INCLUDED BY 

G Amendment G Answer G Cross Bill G Other Pleading 
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In the above— entitled case, the following decision has been rendered or judgement issued: 
DECISION/JUDGEMENT 





CLERK 


(BY) DEPUTY CLERK 


DATE 



Copy 1 —Upon initiation of action, mai! this copy to Director Copy 3— Upon termination of action, mail this copy to 0a-ector 
Copy 2— Upon filing docament adding pateotCs), mail this copy to Director Copy 4--Case tite copy 
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29. As a legal consequence of Defendant's infringement, Plaintiff is 
entitled to compensation for no less than a reasonable royalty, as well as pre- 
judgment interest and a preliminary and permanent injunction. In the event that the 
Court does not exercise its equitable discretion to award a permanent injunction, 
then Plaintiff is entitled to a judgment that includes a sum equal to the total 
projected value of a compulsory license for the life of the patent at a royalty rate to 
be determined by a jury, discounted to present value, to compensate Plaintiff for 
future infringement. 

30. The infringement of the '846 Patent has been willful in that Defendant 
is fully aware of Plaintiffs rights, yet has continued to use the infringing IVR 
system in violation of the patent laws without a good faith basis for believing it 
does not infringe or the patent is invalid. This intentional refusal to respect 
Plaintiffs patent rights constitutes willful infringement under 35 U.S.C. §§ 284 and 
285, thereby entitling Plaintiff to treble damages and attorneys* fees. 

V. SECOND COTJNT FOR INFRINGEMENT OF 
UNITED STATES PATENT NO. 6.665.640 

31. Plaintiff hereby incorporates by reference the allegations contained in 
paragraphs 1 through 25. 

32. Plaintiff is the assignee of the U.S. Patent No. 6,665,640 ("the '640 
Patent"), attached hereto as Exhibit 2, entitled "Interactive Speech Based 
Learning/Training System Formulating Search Queries Based on Natural Language 
Parsing of Recognized User Queries". Plaintiff owns and has standing and capacity 
to sue and recover damages for infringement under the *640 Patent. 

33. Defendant has violated Plaintiffs patent rights by operating an IVR 
system covered by at least one claim of the '640 Patent. Wells Fargo' s infringing 
IVR system has not been manufactured or authorized in any manner by the 
Plaintiff. 
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34. As a legal consequence of Defendant's infringement, Plaintiff is 
entitled to compensation for no less than a reasonable royalty, as well as pre- 
judgment interest and a preliminary and permanent injunction. In the event that the 
Court does not exercise its equitable discretion to award a permanent injunction, 
then Plaintiff is entitled to a judgment that includes a sum equal to the total 
projected value of a compulsory license for the life of the patent at a royalty rate to 
be determined by a jury, discounted to present value, to compensate Plaintiff for 
future infringement. 

35. The infringement of the '640 Patent has been willful in that Defendant 
is fully aware of Plaintiffs rights, yet has continued to use the infringing IVR 
system in violation of the patent laws without a good faith basis for believing it 
does not infringe or the patent is invalid. This intentional refusal to respect 
Plaintiffs patent rights constitutes willful infringement under 35 U.S.C. §§ 284 and 
285, thereby entitling Plaintiff to treble damages and attorneys' fees. 

VI. THIRD COUNT FOR INFRINGEMENT 
OF UNITED STATES PATENT NO- 7.050.977 

36. Plaintiff hereby incorporates by reference the allegations contained in 
paragraphs 1 through 25. 

37. Plaintiff is the assignee of the U.S. Patent No. 7,050,977 ("the '977 
Patent"), attached hereto as Exhibit 3, entitled "Speech-Enabled Server for Internet 
Website and Method". Plaintiff owns and has standing and capacity to sue and 
recover damages for infringement under the '977 Patent. 

38. Defendant has violated Plaintiffs patent rights by operating an IVR 
system covered by at least one claim of the '977 Patent. Wells Fargo' s infringing 
IVR system has not been manufactured or authorized in any manner by the 
Plaintiff. 
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39. As a legal consequence of Defendant's infringement, Plaintiff is 
entitled to compensation for no less than a reasonable royalty, as well as pre- 
judgment interest and a preliminary and permanent injunction. In the event that the 
Court does not exercise its equitable discretion to award a permanent injunction, 
then Plaintiff is entitled to a judgment that includes a sum equal to the total 
projected value of a compulsory license for the life of the patent at a royalty rate to 
be determined by a jury, discounted to present value, to compensate Plaintiff for 
future infringement. 

40. The infringement of the *977 Patent has been willful in that Defendant 
is fully aware of Plaintiffs rights, yet has continued to use the infringing IVR 
system in violation of the patent laws without a good faith basis for believing it 
does not infringe or the patent is invalid. This intentional refusal to respect 
Plaintiffs patent rights constitutes willful infringement under 35 U.S.C. §§ 284 and 
285, thereby entitling Plaintiff to treble damages and attorneys' fees. 

VIL FOURTH COUNT FOR INFRINGEMENT 
OF UNITED STATES PATENT NO. 7,277.854 

41. Plaintiff hereby incorporates by reference the allegations contained in 
paragraphs 1 through 25. 

42. Plaintiff is the assignee of the U.S. Patent No. 7,277,854 ("the ^854 
Patent"), attached hereto as Exhibit 4, entitled "Speech Recognition System 
Interactive Agent". Plaintiff owns and has standing and capacity to sue and recover 
damages for infringement under the *854 Patent. 

43. Defendant has violated Plaintiffs patent rights by operating an IVR 
system covered by at least one claim of the '854 Patent. Wells Fargo's infringing 
IVR system has not been manufactured or authorized in any manner by the 
Plaintiff. 
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44. As a legal consequence of Defendant's infringement, Plaintiff is 
entitled to compensation for no less than a reasonable royalty, as well as pre- 
judgment interest and a preliminary and permanent injunction. In the event that the 
Court does not exercise its equitable discretion to award a permanent injunction, 
then Plaintiff is entitled to a judgment that includes a sum equal to the total 
projected value of a compulsory license for the life of the patent at a royalty rate to 
be determined by a jury, discounted to present value, to compensate Plaintiff for 
future infringement. 

45. The infringement of the '854 Patent has been willful in that Defendant 
is fully aware of Plaintiffs rights, yet has continued to use the infringing IVR 
system in violation of the patent laws without a good faith basis for believing it 
does not infringe or the patent is invalid. This intentional refusal to respect 
Plaintiffs patent rights constitutes willful infringement under 35 U.S.C. §§ 284 and 
285, thereby entitling Plaintiff to treble damages and attorneys' fees. 

VIII. DEMAND FOR JURY TRIAL 

46. Plaintiff hereby exercises its right to a jury trial under the Seventh 
Amendment to the United States Constitution, and pursuant to Fed. R. Civ. Proc, 
Rule 38, demands a jury trial in accordance therewith. 

TX. PRAYER FOR RELIEF 
WHEREFORE, Plaintiff prays for: 

a. A preliminary injunction, barring Defendant and all of its agents, 
officers, attorneys, successors, and assigns from manufacturing, importing or using 
any system (or components thereof) that infringes upon the '846, the '640, the '977 
and the '854 Patents; 

b. A permanent injunction, barring Defendant and all of its agents, 
officers, successors and assigns from manufacturing, importing or using any system 
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(or components thereof) that infringes upon the '846, the *640, the '977 and the 
'854 Patents; 

c. That Defendant be required to account to Plaintiff for all savings and 
revenues realized by Defendant and any subsidiary and any partner company of 
Defendant from the use of IVR systems infringing the '846, the '640, the '977 and 
the '854 Patents; 

d. A judgment for compensatory damages, not less than reasonable 
royalty, suffered as a result of the patent infringement as well as prejudgment 
interest; 

e. A judgment including a sum equal to a the total projected value of a 
compulsory license for the life of the patents, discounted to present value, to 
compensate Plaintiff for future infringement in the event that a permanent 
injunction is not av^arded; 

f. Treble damages and attorneys' fees pursuant to 35 U.S.C. §§ 284 and 
285 for willful infringement of the '846, the '640, the '977 and the '854 Patents by 
Defendant; and, 

g. Any and all other relief that the Court deems proper. 

Respectfully submitted, 

TROJAN LAW OFFICES 
by 



Dated: February 6, 2008 
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R. Joseph Trojan CABarNo. 137,068 
trojan@trojaiilawoffices.com 
TROJAN LAW OFFICES 

9250 Wilshire Blvd., Suite 325 ORlQiV ^* 1 

Beverly Hills, CA 90212 fliPQ 
Telephone: 310-777-8399 

Facsimile: 310-777-8348 '^tB ^ 8 2ood 

Attorneys for Plaintiff; E"g^^|||H^^ 
PHOENIX SOLUTIONS, INC. ™"=f"'^^9p6^.Lr<,RWA 

UNITED STATES DISTRICT COURT 
NORTHERN DISTRICT OF CALIFORNIA £AfC 



PHOENIX SOLUTIONS, INC., a 
California corporation. 

Plaintiff, 

V. 

WELLS FARGO & COMPANY, a 
Delaware corporation, 

Defendant. 



e?"^8 0863 

COMPLAINT FOR DAMAGES AND 
INJUNCTIVE RELIEF FOR 
INFRINGEMENT OF U.S. PATENT 
NOS. 6,633,846, 6,665,640, 7,050,977 
AND 7,277,854 UNDER 35 U.S.C. § 
271 AND DEMAND FOR JURY 
TRIAL PURSUANT TO FED. R. CIV. 
PROC, RULE 38 
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Plaintiff, PHOENIX SOLUTIONS, INC, (hereinafter "Plaintiff or 
"Phoenix"), hereby complains against Defendant, WELLS FARGO & COMPANY 
(hereinafter "Defendant" or "Wells Fargo"), as follows: 

1. This is a civil action for patent infringement arising under the patent 
laws of the United States, 35 U.S.C. fillet seq. 

L THE PARTIES 

2. Plaintiff is a corporation organized and existing under the laws of the 
State of California, with a place of business at 634 Georgia Avenue, Palo Alto, 
California, 94306. 

3. Upon information and belief. Defendant is a corporation organized and 
existing under the laws of the State of Delaware with a place of business at 420 
Montgomery Street, San Francisco, California, 94163. 

n. FACTUAL BACKGROUND 

4. Plaintiff is the owner by assignment of U.S. Patent Nos. 6,633,846, 
6,665,640, 7,050,977, and 7,277,854 (hereinafter "Patents in Suit") directed to 
"speech recognition software". 

5. Plaintiff Phoenix developed the next generation of speech recognition 
systems that give users the ability to have a verbal conversation with a computer 
about a subject on which the computer has been programmed to process and 
generate intelligent responses. One of the first applications of this new technology 
was its use in telephone customer service lines where the customer calls a computer 
and a "virtual customer service agent" answers the line and interacts with a caller 
using "natural speech" akin to a live person. 

6. Phoenix encompasses the life work of a pioneer in the field of 
computer-based speech recognition, Dr. Ian Bennett. Originally from Jamaica, Dr. 
Bennett graduated with honors from the University of British Columbia and went 
on to receive his Master's and Doctorate degrees in electrical engineering from 
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Stanford University. While at Stanford, Dr. Bennett developed the first practical 
analog processor for speech compression. After graduation he held technical 
engineering positions with several high technology companies and contributed to 
device and product development. As a consultant to the Variable Speech Corp. of 
Tokyo, Japan, he contributed to the development of an analog speech compression 
VLSI speech processor used for audio compression in consumer speech recorders. 
In 1994, Dr. Bennett began the development of a natural language query system 
(NLQS). Subsequently, he founded Phoenix Solutions, where he guided the 
development of algorithms for statistics- and semantics-based signal processing of 
speech that allow a computer to take in natural speech questions and return answers 
that also sound like natural speech. Dr. Bennett developed various applications for 
his technology, including interactive conversational systems and interactive guides, 
intelligent tutoring systems and form-filling systems. Dr. Bennett is currently at the 
National Science Foundation serving as a Program Director within the Directorate 
of Engineering, Division of Industrial Innovation & Partnerships. 

7, Defendant Wells Fargo is a financial services company that provides 
banking, insurance, investment, mortgage loan, and consumer finance services. In 
connection with its electronic services. Defendant (and/or others on its behalf) 
established and operates a number of customer support lines, which can be reached 
for example at (800) 642-4720 and upon information and belief, other toll-free 
phone numbers. The customer support lines employ a natural language interactive 
voice response (IVR) system that includes a virtual agent (hereinafter 
interchangeably referred to as "IVR system"). 

8. The Plaintiff's natural language IVR system is superior to 
conventional touch-tone systems because the caller can simply talk to the system 
using natural language. In contrast, touch-tone IVR systems require the caller to 
select from a series of choices using a more limited telephone keypad. IVR touch 
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tone systems are also less efficient since they require callers to listen to an entire 
menu of choices and wade through a series of menus before providing a response to 
the caller. Consumers hang up at a greater rate in frustration when they become 
lost in the maze of menus. 

9. The alternative to touch tone menu systems is to employ live 
operators. When compared to live operators, the Plaintiff's IVR system is much 
more cost effective. Based upon industry data, it is estimated that Defendant's use 
of its current IVR system has allowed it to save 93% of the cost it previously 
incurred in providing its customer support line and Defendant's customer 
satisfaction has increased by 30%. 

10. Upon information and belief. Defendant operates its IVR system using 
a combination of telephony hardware and computer server hardware that is 
specifically adapted by Defendant (and/or otiiers on its behalf) to respond to spoken 
questions from callers concerning the Defendant's business. Such hardware uses 
supporting software that includes speech recognition and natural language engines 
used to understand the spoken questions from callers. 

11. Upon information and belief, the speech recognition engine used by 
Defendant is distributed, so that some of the speech-processing operations for 
understanding callers are performed on a client computing system (such as 
telephony platform or other hardware) while other speech processing operations are 
performed on a separate server computing system. Upon information and belief, 
Defendant (and/or others on its behalf) configure such computing systems to 
customize what speech processing operations will take place on such respective 
hardware systems to maximize certain characteristics of the system, and to regulate 
how speech data from the callers is transferred between such systems. 

12. When customers place calls to Defendant's IVR system, they can 
speak in a conversational style as if they were speaking to a real person. 
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Defendant's interactive virtual agent responds to the caller's questions in real-time 
by providing answers in natural speech. The virtual agent has been taught natural 
language dialogues based on information concerning Defendant's products 
provided by the Defendant and incorporated into the software. In this manner, the 
virtual agent can understand questions posed by customers concerning Defendant's 
products, and give relevant answers. 

13. Defendant's IVR system uses a speech recognition engine to break 
down the customer's questions into specific words understood by the IVR system. 
For example, the speech recognition engine could determine that the user has said 
his or her account number. Defendant controls precisely what specific words its 
IVR system will understand as part of its vocabulary by configuring (and/or having 
others configure on its behalf) certain aspects of such client computing system 
and/or server computing system. 

14. Defendant's IVR system employs a natural language engine to 
understand the meaning of the specific words spoken by its customers. The IVR 
system, by understanding the meaning and context of specific words, may 
determine that the customer is asking about a service related problem. Defendant 
controls precisely what interpretation the IVR system should give to various words 
spoken by its customers by configuring (and/or having others configure on its 
behalf) certain aspects of the client computing system and/or server computing 
system. 

15. Based on determining the most likely meaning of the customer's 
specific question, the interactive virtual agent responds with a specific answer. The 
answer may take the form of an audible response from the agent, or it may take the 
form of the IVR system routing the caller to a live person working within the 
appropriate department (such as the service department in the example above). In 
all instances, Defendant alone controls precisely what responses and actions virtual 
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agent takes, and has configured (and/or has had others configure on its behalf) 
certain aspects of such client computing system and/or server computing system to 
provide such desired responses or actions. 

16. Upon information and belief, Defendant also configured and controlled 
(and/or has had others configure and/or control on its behalf) other aspects of the 
virtual agent's overall behavior, including among other things, the gender, apparent 
age, speech rate, prosody, style and rate of response. These parameters are selected 
and controlled by Defendant to increase customer satisfaction with the customer 
support line. 

17. Upon information and belief. Defendant (and/or others on its behalf) 
designed, customized and selected the personality exhibited by the virtual agent as 
well. This electronic persona was specifically selected to be appealing and 
attractive to Defendant's customers and to maximize utilization of the IVR system 
by such customers. 

18. Upon information and belief, the information used by Defendant's 
IVR system (including e.g., the grammar used, specific questions to which it can 
respond, the interpretation of questions, and the answers to be given to customers) 
were derived by Defendant (and/or others on its behalf) from collecting and 
studying data from thousands of actual calls made to Defendant's customer support 
line. Based on this, Plaintiff believes that Defendant (and/or others on its behalf) 
has trained the IVR system with Defendant's call center data that is unique to 
Defendant's business. As a result, the IVR system is tailored to respond with 
appropriate answers to questions posed by Defendant's customer base. 

19. Accordingly, Defendant's IVR system has been customized with 
customer content data that is not available from a third party. This Defendant- 
specific content data is critically important to the behavior and operation of 
Defendant's IVR system, since without it the IVR system would not know what 
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words to recognize from a caller's utterance, how to determine the meaning of such 
words, and/or what answer to give to the caller as a response. 

20. Defendant's IVR system, as noted above, is a combination of 
components, including at least some hardware, software and content which it 
obtained from third parties (third party components). Nonetheless, and on 
information and belief, Defendant is responsible for and has caused such third party 
components to be combined, adapted and configured (including with such 
Defendant- specific content) in accordance with specific performance, content 
requirements and scenarios of the Defendant's customer support operations. 

21. Consequently, and on further information and belief, the current 
structure and operation of Defendant's IVR system is a result of content 
contributions, performance specifications and operational specifications provided 
by Defendant and configuration/modification of third party components made by 
Defendant (and/or others on its behalf). Such third party components - as currently 
available from such third parties - by themselves would not be sufficient to 
implement Defendant's IVR system without Defendant's cooperation, contributions 
and actions, including Defendant's provision of the Defendant-specific content 
data. 

22. On or about June 2, 2006, Plaintiff sent a letter to Defendant, stating 
that the IVR system is covered by one or more claims of the Patents in Suit. In that 
letter, Plaintiff included a number of supporting materials to explain its position on 
the Patents, and further extended an offer to license the Patents in Suit to 
Defendant. On or about June 27, 2006, Defendant responded, informing Plaintiff 
that it needed to investigate the matter and requested identification of the patent 
claims that may be infringed. On or about June 29, 2006, Plaintiff responded to 
Defendant, stating that Defendant may have overlooked the CD enclosed with the 
original letter which has extensive representative claim charts pointing out 
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particularly which claims Plaintiff believes are pertinent to Defendant's system and 
why. Some many months later on October 18, 2007, and having not heard from 
Defendant, Plaintiff sent another letter to Defendant to again negotiate a license and 
requested a response by no later than December 14, 2007. Defendant failed to 
respond in any meaningful way to the licensing offer or the charge of infringement, 
necessitating the fihng of this action. 

III. JURISDICTION AND VENUE 

23. This Court has original subject matter jurisdiction over Plaintiff's 
patent infringement claim pursuant to 28 U.S.C. § 1338(a). 

24. This Court has personal jurisdiction over Defendant because 
Defendant's corporate headquarters are located in San Francisco, CA. 

25. Venue properly lies in the Northern District of California pursuant to 
28 U.S.C. §1391 and §1400, because the acts complained of herein have been 
committed and are being committed in this Judicial District and Defendant is 
subject to personal jurisdiction within the District. 

IV. FIRST COUNT FOR INFRINGEMENT 
OF UNITED STATES PATENT NO. 6.633.846 

26. Plaintiff hereby incorporates by reference the allegations contained in 
paragraphs 1 through 25. 

27. Plaintiff is the assignee of the U.S. Patent No. 6,633,846 ("the '846 
Patent"), attached hereto as Exhibit 1, entitled "Distributed Real Time Speech 
Recognition System". Plaintiff owns and has standing and capacity to sue and 
recover damages for infringement under the *846 Patent. 

28. Defendant has violated Plaintiffs patent rights by operating an IVR 
system covered by at least one claim of die '846 Patent. Wells Fargo' s infringing 
IVR system has not been manufactured or authorized in any manner by the 
Plaintiff. 
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